Deriving reference mode values and encoding and decoding information representing prediction modes

ABSTRACT

Reference prediction mode values, also referred to as most probable modes, usable for encoding or decoding of a prediction mode related to a current coding unit, are derived. First and second reference prediction mode values are derived (S 402 ) from respective prediction modes of at least two neighbouring coding units of the current coding unit. The first and second reference prediction modes are different. A third reference prediction mode value is derived (S 403 ) from the first and second reference prediction mode values. The third reference prediction mode is different from each of said first and second reference prediction mode values. 
     By deriving three MPMs instead of two for comparison with the prediction mode of the current coding block the coding efficiency is improved. This is due to the increase in the probability that the prediction mode of the current coding block corresponds to one of the derived most probable modes.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation Ser. No. 15/891,763, filed on Feb. 8,2018 that is a Continuation of U.S. patent application Ser. No.14/344,315, filed on Sep. 11, 2014, that is the National Phaseapplication of PCT Application No. PCT/EP2012/003829, filed on Sep. 12,2012 and titled “Deriving reference mode values and encoding anddecoding information representing prediction modes”. This applicationclaims the benefit under 35 U.S.C. § 119(a)-(d) of United Kingdom PatentApplication No. 1115739.3, filed on Sep. 12, 2011 and titled “Method anddevice for encoding or decoding information representing predictionmodes”. The above cited patent applications are hereby incorporated byreference herein in their entireties.

FIELD OF THE INVENTION

The invention relates to a method and a device for encoding or decodingmode values representing prediction modes. Particularly, but notexclusively the invention relates more specifically to intra mode codingin the High Efficiency Video Coding (HEVC) standard under development.

DESCRIPTION OF THE PRIOR ART

Video applications are continuously moving towards higher resolution. Alarge quantity of video material is already distributed in digital formover broadcast channels, digital networks and packaged media, with acontinuous evolution towards higher quality and resolution (e.g. highernumber of pixels per frame, higher frame rate, higher bit-depth orextended color gamut). This technology evolution brings higher pressureon the distribution networks that are already facing difficulties tocarry HDTV resolution and data rates economically to the end user.Therefore, any further data rate increase will put additional pressureon the networks. To handle this challenge, ITU-T and ISO/MPEG decided tolaunch in January 2010 a new video coding standard project, named HighEfficiency Video Coding (HEVC).

The HEVC codec design is similar to that of most previous so-calledblock-based hybrid transform codecs such as H.263, H.264, MPEG-1,MPEG-2, MPEG-4, SVC. Video compression algorithms such as thosestandardized by the standardization bodies ITU, ISO and SMPTE use thespatial and temporal redundancies of the images in order to generatedata bit streams of reduced size compared with these video sequences.Such compressions make the transmission and/or storage of the videosequences more effective.

During video compression in the proposed HEVC encoder, each block of animage being processed is predicted spatially by an “Intra” predictor(so-called “Intra” coding mode), or temporally by an “Inter” predictor(so-called “Inter” coding mode). Each predictor is a block of pixelsissued from the same image or another image, from which a differenceblock (or “residual”) is derived. In the Intra coding mode the predictor(Intra predictor) used for the current block is a block of pixelsconstructed from the information already encoded of the current image.By virtue of the identification of the predictor block and the coding ofthe residual, it is possible to reduce the quantity of informationactually to be encoded.

The encoded frames are of two types: temporal predicted frames (eitherpredicted from one reference frame called P-frames or predicted from tworeference frames called B-frames) and non-temporal predicted frames(called Intra frames or I-frames). In I-frames, only Intra prediction isconsidered for coding blocks. In P-frames and B-frames, Intra and Interprediction are considered for coding blocks.

If “Intra” coding is selected, an item of information for describing the“Intra” predictor used is coded before being inserted in the bit streamto be sent to a corresponding decoder.

In the current HEVC design, as well as in previous designs such asMPEG-4 AVC/H.264, intra coding involves deriving an intra predictionblock from reconstructed neighboring samples 101 of the block to beencoded (decoded), as illustrated schematically in FIGS. 1A and 1BMultiple prediction modes are supported, either directional ornon-directional. In HEVC the number of supported modes depends on thesize of a coding unit (CU). As at the filing date of the presentapplication the HEVC specification is still subject to change butpresently the following supported modes are contemplated: 4 modes for64×64 CU, 18 modes for 4×4 CU, 35 modes for CU of other sizes (8×8 to32×32).

When a CU is intra coded, its related intra prediction mode has to becoded. Referring to FIG. 1B, when coding a current CU 102, Intra modecoding makes use of two neighbouring CUs that have already been coded,namely the Top and Left CUs 103 and 104.

FIG. 2 illustrates intra prediction modes considered in HEVC. The intraprediction modes include a planar prediction mode identified by a modeprediction value 0, a DC mode having a mode prediction value 3 and anumber of directional prediction modes identified by mode predictionvalues 4 to 34 for predicting directional structures in an imagecorresponding to different angles. Also included are horizontalprediction mode 2 and vertical prediction mode 1.

FIG. 3 is a flowchart for use in explaining how Intra mode coding isperformed in the current HEVC design. In a first step S201 the Intraprediction modes of the neighboring Top and Left CUs 103 and 104, asillustrated in FIG. 1B, are identified. The two CUs may share the sameIntra prediction mode or may have different Intra prediction modes.Accordingly, in step S201 one or two different intra prediction modescan be identified. In step S202, two ‘Most Probable Modes’ (MPMs), arederived from the identified intra prediction modes. If the predictionmodes of the Top and Left CUs 103 and 104 are different, then two MPMs,MPM0 and MPM1, are set to respectively the minimum and maximum value ofthe Top and Left CU prediction modes. If the prediction modes from theTop and Left CUs 103 and 104 are equal, and if they do not correspond tothe Planar prediction mode, then MPM0 is set equal to Planar mode andMPM1 is set to the prediction mode of the Top or Left CUs predictionmode. If the prediction modes of the Top and Left CUs 103 and 104 bothcorrespond to the Planar mode, then MPM0 is set equal to the Planar modeand MPM1 is set to the DC mode. MPM0 and MPM1 are thus ordered accordingto their prediction mode values, the prediction mode having the smallermode value being referred to as MPM0 and the prediction mode having thegreater mode value being referred to as MPM1. In step S203 theprediction mode of the current coding unit is then compared to the twoMPMs. If the prediction mode of the current coding unit is equal toeither MPM0 or MPM1 then in step S204 a first coding process (process 1)is applied.

This first coding process involves coding a flag signaling that the modeof the current block is equal to one of the MPMs, and then, coding theindex of the MPM concerned (0 if MPM0, 1 if MPM1).

If in step S203 it is determined that the prediction mode of the currentblock is not equal to one of the two MPMs, then in step S205 a secondcoding process (process 2) is applied.

Unlike the first coding process, the second coding process involvescoding the mode value of the current block.

Statistically process 1 is more often used than process 2.Statistically, a prediction mode is more often equal to one of its MPMsthan different from all of the MPMs. The entropy coding engine benefitsfrom this property, either by using shorter codewords in process 1 thanin process 2, or by exploiting the higher probability of being equal toone of the MPMs (arithmetic coding as used in CABAC efficiently exploitsthe probability to improve the encoding and reduce the coding cost). Thepresent invention has been devised to address one or more of theforegoing concerns and desires. It is desirable to improve the codingefficiency of methods for encoding prediction mode information.

According to a first aspect of the invention there is provided a methodof encoding mode information representing a prediction mode related to acurrent coding unit by an intra mode coding process, a method ofencoding a mode value representing a prediction mode related to acurrent coding unit to be encoded, the method comprising: deriving firstand second reference prediction mode values from respective predictionmodes of at least two neighbouring coding units of the current codingunit, the first and second reference prediction modes being differentfrom one another; and comparing the prediction mode value to be encodedwith one or more of the reference prediction mode values; and selecting,based on the comparison, an encoding process, from among at least firstand second encoding processes, to apply to the mode value to be encoded;wherein, the method further comprises deriving a third referenceprediction mode value from the first and second reference predictionmode values, the third reference prediction mode being different fromeach of said first and second reference prediction mode values; and saidcomparison comprises comparing the prediction mode value to be encodedwith at least one of the first, second and third reference predictionmode values.

By deriving three MPMs instead of two for comparison with the predictionmode of the current coding block the coding efficiency is improved. Thisis due to the increase in the probability that the prediction mode ofthe current coding block corresponds to one of the derived most probablemodes. Since this enables a more economical encoding process to be usedto encode the prediction mode of the current coding block, the overallcoding cost is reduced.

According to a second aspect of the invention there is provided a devicefor encoding mode information representing a prediction mode related toa current coding unit, the device comprising: derivation means forderiving first and second reference prediction mode values fromrespective prediction modes of at least two neighbouring coding units ofthe current coding unit, the first and second reference prediction modesbeing different from one another; and comparison means for comparing theprediction mode value to be encoded with one or more of the referenceprediction mode values; and selection means for selecting, based on thecomparison, an encoding process, from among at least first and secondencoding processes, to apply to the mode value to be encoded; wherein,the derivation means is operable to derive a third reference predictionmode value from the first and second reference prediction mode values,the third reference prediction mode being different from each of saidfirst and second reference prediction mode values; and said comparisonmeans is operable to compare the prediction mode value to be encodedwith at least one of the first, second and third reference predictionmode values.

According to a third aspect of the invention there is provided a methodof decoding a mode value representing a prediction mode related to acurrent decoding unit to be decoded, the method comprising: derivingfirst and second reference prediction mode values from respectiveprediction modes of at least two neighbouring decoding units of thecurrent decoding unit, the first and second reference prediction modesbeing different from one another; and comparing the prediction modevalue to be decoded with one or more of the reference prediction modevalues; and selecting, based on the comparison, a decoding process, fromamong at least first and second decoding processes, to apply to the modevalue to be decoded; wherein, the method further comprises deriving athird reference prediction mode value from the first and secondreference prediction mode values, the third reference prediction modebeing different from each of said first and second reference predictionmode values; and said comparison comprises comparing the prediction modevalue to be decoded with at least one of the first, second and thirdreference prediction mode values.

According to a fourth aspect of the invention there is provided a devicefor decoding a mode value representing a prediction mode related to acurrent decoding unit to be decoded, the device comprising: derivationmeans for deriving first and second reference prediction mode valuesfrom respective prediction modes of at least two neighbouring decodingunits of the current decoding unit, the first and second referenceprediction modes being different from one another; and comparison meansfor comparing the prediction mode value to be encoded with one or moreof the reference prediction mode values; and selection means forselecting, based on the comparison, a decoding process, from among atleast first and second decoding processes, to apply to the mode value tobe decoded; wherein, the derivation means is operable to derive a thirdreference prediction mode value from the first and second referenceprediction mode values, the third reference prediction mode beingdifferent from each of said first and second reference prediction modevalues; and said comparison means is operable to compare the predictionmode value to be decoded with at least one of the first, second andthird reference prediction mode values.

According to a further aspect of the invention there is provided amethod of deriving reference prediction mode values for encoding ordecoding of a prediction mode related to a current coding unit, themethod comprising: deriving first and second reference prediction modevalues from respective prediction modes of at least two neighbouringcoding units of the current coding unit, the first and second referenceprediction modes being different from one another; and deriving a thirdreference prediction mode value from the first and second referenceprediction mode values, the third reference prediction mode beingdifferent from each of said first and second reference prediction modevalues; wherein the first, second and third reference prediction modevalues are usable for comparison with the prediction mode value to beencoded or decoded.

In an embodiment, the third reference prediction mode value is set to amode value corresponding to a planar prediction mode if none of saidfirst and second reference prediction mode values corresponds to theplanar prediction mode.

In an embodiment, if one of the first and second reference predictionmode values corresponds to a DC prediction mode and the other of thefirst and second reference prediction mode values corresponds to aplanar prediction mode, the further prediction mode value is set to apredefined prediction mode value.

In an embodiment, the predefined prediction mode value is signalled in aslice or picture header.

In an embodiment, the predefined prediction mode value has a smallprediction mode value, such as for example a prediction mode value lessthan 5.

In an embodiment, the predefined prediction mode value corresponds to ahorizontal prediction mode or a vertical prediction mode.

In an embodiment, the predefined prediction mode value is dependent uponthe content of the image being encoded.

In an embodiment, the predefined prediction mode value is adaptivelyderived based on mode probabilities representative of the probability ofoccurrence of respective prediction modes, said mode probabilities beingregularly computed.

In an embodiment, if one of the first and second reference predictionmode values corresponds to a directional prediction mode and the otherof the first and second reference prediction mode values corresponds toa planar prediction mode, the third prediction mode value is set at aprediction mode value corresponding to the prediction mode with the nextangular direction superior to the direction of the reference predictionmode value concerned.

In an embodiment, the at least two neighbouring encoding or decodingunits comprise the left neighbouring encoding unit or decoding and thetop neighbouring encoding or decoding unit of the current encoding ordecoding unit.

In an embodiment, the first encoding or decoding process comprisesencoding or decoding first information indicating a predeterminedrelationship between the mode value to be encoded or decoded and atleast one of the first, second and third reference prediction modevalues, and the second encoding or decoding process comprises encodingor decoding second information representing the mode value to be encodedor decoded.

In an embodiment, the first encoding or decoding process is selectedwhen the mode value to be encoded or decoded is equal to at least one ofthe three reference prediction mode values, and the second encoding ordecoding process is selected when the mode value to be encoded ordecoded differs from each of the three reference prediction mode values.

At least parts of the methods according to the invention may be computerimplemented. Accordingly, the present invention may take the form of anentirely hardware embodiment, an entirely software embodiment (includingfirmware, resident software, micro-code, etc.) or an embodimentcombining software and hardware aspects that may all generally bereferred to herein as a “circuit”, “module” or “system”. Furthermore,the present invention may take the form of a computer program productembodied in any tangible medium of expression having computer usableprogram code embodied in the medium.

Since the present invention can be implemented in software, the presentinvention can be embodied as computer readable code for provision to aprogrammable apparatus on any suitable carrier medium. A tangiblecarrier medium may comprise a storage medium such as a floppy disk, aCD-ROM, a hard disk drive, a magnetic tape device or a solid statememory device and the like. A transient carrier medium may include asignal such as an electrical signal, an electronic signal, an opticalsignal, an acoustic signal, a magnetic signal or an electromagneticsignal, e.g. a microwave or RF signal.

Embodiments of the invention will now be described, by way of exampleonly, and with reference to the following drawings in which:—

FIGS. 1A and 1B, discussed hereinbefore, are schematic diagrams for usein explaining how an intra prediction block is derived in the currentHEVC design;

FIG. 2, also discussed hereinbefore, schematically illustrates intraprediction modes in the current HEVC design,

FIG. 3, also discussed hereinbefore, is a flowchart for use inexplaining intra mode coding in the current HEVC design;

FIG. 4 is a flowchart for use in explaining a principle of intra modecoding according to at least one embodiment of the present invention;

FIG. 5 is a flowchart of steps of a method for deriving a referenceprediction mode value according to an embodiment of the presentinvention;

FIG. 6 is a flowchart illustrating steps related to the method of FIG.5;

FIG. 7 shows a sequence of images;

FIG. 8 shows parts of apparatus suitable for implementing an encoderaccording to an embodiment of the present invention;

FIG. 9 shows a block diagram of parts of an encoder according to atleast one embodiment of the present invention; and

FIG. 10 illustrates a block diagram of parts of a decoder.

DETAILED DESCRIPTION OF THE EMBODIMENTS

FIG. 4 is a flowchart for use in explaining a principle of an intra modecoding method embodying the present invention. The intra mode codingmethod according to this flowchart is applicable to any entropy codingengines such as CABAC or CAVLC.

In FIG. 4, steps S401 and S402 are the same as steps S201 and S202,respectively, in FIG. 3, and the description of these steps is notrepeated here.

In step S403 a third most probable mode (MPM2) is derived from the firstand second most probable modes MPM0 and MPM1 derived from the predictionmodes of the neighbouring top and left CUs in step S402.

FIG. 5 is a flow chart illustrating in more detail the steps forderiving the third most probable mode MPM2 according to a firstembodiment of the invention. In step S501 first and second most probablemodes values MPM0 and MPM1 as derived in step S402 are identified. Instep S502 it is checked as to whether one of the most probable modevalues MPM0 and MPM1 corresponds to a planar prediction mode. This stepmay involve checking both most probable mode values to check if theycorrespond to a planar prediction mode. In an alternative embodiment ofthe invention when the most probable mode values MPM0 and MPM1 have beenordered according to their prediction mode values it may only benecessary to check if MPM0 corresponds to a planar mode since MPM0 willcorrespond to the lower order prediction mode. If neither MPM0 nor MPM1correspond to a planar prediction mode, the further most probable modeMPM2 is set at a mode value corresponding to a planar prediction mode instep S506. Since a planar mode is statistically the most frequently usedprediction mode, it is beneficial to insert it into the set of MPMs forthe later comparison step, since it is a more likely to correspond tothe prediction mode of the current block.

If, however, it is determined in step S502 that either one of the firstand second MPMs, MPM0 or MPM1, corresponds to a planar mode, it is thenchecked in step S503 if the other MPM0 or MPM1 corresponds to a DCprediction mode. If it is determined that one of the first and secondMPMs MPM0 or MPM1 corresponds to a planar prediction mode and the otherof the first and second MPMs MPM0 and MPM1 corresponds to a DCprediction mode, the third MPM MPM2 is set at a pre-defined mode value.

Practically, prediction modes with a small prediction mode value areused because they are more likely to correspond to the prediction modeof the current block. In the example illustrated in FIG. 5, MPM2 is setat a prediction mode value 2 corresponding to the vertical predictionmode.

It may be noted that a prediction mode value 2, corresponding tohorizontal direction prediction could also be chosen, but the verticaldirection is statistically more present in natural images thanhorizontal structures and so is more likely to correspond to theprediction mode of the current block.

In some embodiments of the invention the pre-defined prediction mode maybe signaled in the slice or picture header, since it may be dependent onthe picture content, for instance depending on the statistics of themodes distribution in the image.

In another embodiment of the invention the pre-defined prediction modecan be adaptively derived, based on mode probabilities representative ofthe probability of occurrence of respective prediction modes that areregularly computed In this case, probability tables are defined. Eachtime a mode is coded, its probability is updated. When MPM0 and MPM1 arePlanar and DC, MPM2 is computed as the mode different from Planar and DCwhich has the highest probability value. Therefore the MPM2 is, in thisspecific case of Planar and DC as the two first MPMs, adaptivelycomputed depending on the image content.

If, however it is determined in step S503 that neither of the first MPMMPM0 and the second MPM MPM1 correspond to a DC prediction mode and thatthus one of the first and second MPMs, MPM0 or MPM1 corresponds to adirectional prediction mode MPM_dir, the third MPM MPM2 is set to thedirectional prediction mode with the nearest authorized superior angulardirection to the direction of MPM_dir in step S505. With reference toFIG. 6 which illustrates this process in more detail. In step S601 theprediction mode of the neighbouring coding units which is not a planarmode is identified. In step S602 it is determined if the identifiedprediction mode is DC. If yes MPM2 is set at a vertical prediction mode,otherwise if the identified prediction mode is not a DC MPM2 is set atthe nearest authorized superior angular direction to the direction(MPM_dir) of mode m in step S604.

For example, if MPM_dir is equal to 13, with reference to FIG. 2, MPM2is set to 24 if the current coding unit is of size 8×8 to 32×32, or 6 ifthe current coding unit is of size 4×4 (in the current HEVC design, in4×4 CU, modes with value higher to 17 are forbidden). Using the nearestsuperior angular direction has been experimentally shown to be the mostperforming solution.

It will be appreciated that in some embodiments of the invention theorder of most probable prediction modes MPM0 and MPM1 may be orderedaccording to their prediction values before the third most probableprediction mode MPM2 is derived. In alternative embodiments of theinvention step S402 may no include the process of reordering MPM0 andMPM1 according to their prediction mode value, and then MPM0, MPM1 andMPM2 may be ordered according to their prediction mode value after MPM2has been derived.

Returning to FIG. 4 it is verified in step S404 if the prediction moderelated to the current coding block is equal to the first MPM MPM0, thesecond MPM MPM1 or the third MPM MPM2 derived in steps S402 and S403 inorder to determine whether encoding Process 1 or encoding Process 2 willbe applied to encode the prediction mode value of the current codingblock. Process 1, which is carried out when the mode of the currentblock is equal to one of the three MPMs MPM0, MPM1 or MPM2, isimplemented in step S405. In some embodiments of the present inventionstep S405 can be the same as step S204 in FIG. 3 and will not bedescribed in detail here.

Process 2, which is carried out when the mode of the current block isdifferent from each of the first MPM MPM0, the second MPM MPM1, and thethird MPM, MPM2 is implemented in step S406. Step S406 is the same asthe corresponding step S205 in FIG. 3, and will not be described indetail here.

Using three MPMs instead of two for comparing with the prediction modeof the current coding block improves the coding efficiency since theprobability that the prediction mode of the current coding blockcorresponds to one of the derived most probable modes is increased. Thisin turn increases the likelihood that the more economical encodingprocess 1, which requires less bits to signal the prediction mode of thecurrent coding block, will be used to encode the prediction mode of thecurrent coding block. Consequently the overall coding cost is reduced.At the same time the complexity of the overall process is notover-increased by deriving a large number of MPMs.

FIG. 7 shows the image coding structure 100 used in HEVC. According toHEVC and one of its previous predecessors, the original video sequence1001 is a succession of digital images “images i”. As is known per se, adigital image is represented by one or more matrices the coefficients ofwhich represent pixels.

The images 1002 are divided into slices 1003. A slice is a part of theimage or the entire image. In HEVC these slices are divided intonon-overlapping Largest Coding Units (LCUs) 1004, generally blocks ofsize 64 pixels×64 pixels. Each LCU may in its turn be iterativelydivided into smaller variable size Coding Units (CUs) 1005 using aquadtree decomposition. Each CU can be further partitioned into amaximum of 2 symmetric rectangular Partition Units 1006.

FIG. 8 illustrates a diagram of apparatus 1000 adapted to implement anencoder according to an embodiment of the present invention or toimplement a decoder. The apparatus 1000 is for example a micro-computer,a workstation or a light portable device.

The apparatus 1000 comprises a communication bus 1113 to which there arepreferably connected:

a central processing unit 1111, such as a microprocessor, denoted CPU;

a read only memory (ROM) 1107 which stores one or more computer programsfor implementing the invention;

a random access memory (RAM) 1112 which stores executable code of themethod of the invention and provides registers adapted to recordvariables and parameters necessary for implementing the method ofencoding a sequence of digital images and/or the method of decoding abitstream, and

a communication interface 1102 connected to a communication network 1103over which digital data to be processed are transmitted.

Optionally, the apparatus 1000 may also have the following components:

a data storage means 1104 such as a hard disk, able to contain theprograms implementing the invention and data used or produced during theimplementation of the invention;

a disk drive 1105 for a disk 1106, the disk drive being adapted to readdata from the disk 1106 or to write data onto said disk;

a screen 1109 for displaying data and/or serving as a graphicalinterface with the user, by means of a keyboard 1110 or any otherpointing means.

The apparatus 1000 can be connected to various peripherals, such as forexample a digital camera 1100 or a microphone 1108, each being connectedto an input/output card (not shown) so as to supply multimedia data tothe apparatus 1000.

The communication bus affords communication and interoperability betweenthe various elements included in the apparatus 1000 or connected to it.The representation of the bus is not limiting and in particular thecentral processing unit is able to communicate instructions to anyelement of the apparatus 1000 directly or by means of another element ofthe apparatus 1000.

The disk 1106 can be replaced by any information medium such as forexample a compact disk (CD-ROM), rewritable or not, a ZIP disk or amemory card and, in general terms, by an information storage means thatcan be read by a microcomputer or by a microprocessor, integrated or notinto the apparatus, possibly removable and adapted to store one or moreprograms whose execution enables the method of encoding a sequence ofdigital images and/or the method of decoding a bitstream according tothe invention to be implemented.

The executable code may be stored either in read only memory 1107, onthe hard disk 1104 or on a removable digital medium such as for examplea disk 1106 as described previously. According to a variant, theexecutable code of the programs can be received by means of thecommunication network 1103, via the interface 1102, in order to bestored in one of the storage means of the apparatus 1000 before beingexecuted, such as the hard disk 1104.

The central processing unit 1111 is adapted to control and direct theexecution of the instructions or portions of software code of theprogram or programs according to the invention, instructions that arestored in one of the aforementioned storage means. On powering up, theprogram or programs that are stored in a non-volatile memory, forexample on the hard disk 1104 or in the read only memory 1107, aretransferred into the random access memory 1112, which then contains theexecutable code of the program or programs, as well as registers forstoring the variables and parameters necessary for implementing theinvention.

In this embodiment, the apparatus is a programmable apparatus which usessoftware to implement the invention. However, alternatively, the presentinvention may be implemented in hardware (for example, in the form of anApplication Specific Integrated Circuit or ASIC).

FIG. 9 illustrates a block diagram of an encoder 1200 according to anembodiment of the invention. The encoder is represented by connectedmodules, each module being adapted to implement, for example in the formof programming instructions to be executed by the CPU 1111 of apparatus1000, a corresponding step of a method implementing an embodiment of theinvention.

An original sequence of digital images i₀ to i_(n) 1001 is received asan input by the encoder 1200. Each digital image is represented by a setof samples, known as pixels.

A bitstream 1210 is output by the encoder 1200.

Note that, in the following description we sometimes use the term“block” in place of the specific terminology CU and PU used in HEVC. ACU or PU is a block of pixels.

The input digital images i are divided into blocks by module 1202. Theseblocks are image portions and may be of variable sizes (e.g. 4×4, 8×8,16×16, 32×32, 64×64).

During video compression, each block of an image being processed ispredicted spatially by an “Intra” predictor module 1203, or temporallyby an “Inter” predictor module comprising a motion estimation module1204 and a motion compensation module 1205. Each predictor is a block ofpixels issued from the same image or another image, from which adifference block (or “residual”) is derived. By virtue of theidentification of the predictor block and the coding of the residual, itis possible to reduce the quantity of information actually to beencoded.

The encoded frames are of two types: temporal predicted frames (eitherpredicted from one reference frame called P-frames or predicted from tworeference frames called B-frames) and non-temporal predicted frames(called Intra frames or I-frames). In I-frames, only Intra prediction isconsidered for coding CUs/PUs. In P-frames and B-frames, Intra and Interprediction are considered for coding CUs/PUs.

In the “Intra” prediction module 1203, the current block is predicted bymeans of an “Intra” predictor, a block of pixels constructed from theinformation already encoded of the current image.

With regard to the “Inter” coding, two prediction types are possible.Mono-prediction (P-type) consists of predicting the block by referringto one reference block from one reference picture. Biprediction (B-type)consists of predicting the block by referring to two reference blocksfrom one or two reference pictures. An estimation of motion is carriedout by module 1204 between the current CU or PU and reference images1216. This motion estimation is made in order to identify, in one orseveral of these reference images, one (P-type) or several (B-type)blocks of pixels to use them as predictors of this current block. In acase where several block predictors are used (Btype), they are merged togenerate one single prediction block. The reference images used consistof images in the video sequence that have already been coded and thenreconstructed (by decoding).

Generally, the motion estimation carried out by module 1204 is a blockmatching algorithm (BMA).

The predictor obtained by the algorithm is then subtracted from thecurrent data block to be processed so as to obtain a difference block(block residual). This processing is called “motion compensation” and iscarried out by module 1205.

These two types of coding thus supply several texture residuals (thedifference between the current block and the predictor block), which arecompared in a module 1206 for selecting the best coding mode.

If “Intra” coding is selected, an item of information for describing the“Intra” predictor used is coded by an entropic encoding module 1209before being inserted in the bit stream 1210. Embodiments of the presentinvention described hereinbefore with reference to FIGS. 4 to 6 areapplicable to the entropic encoding module 1209 in FIG. 9.

If the module 1206 for selecting the best coding mode chooses “Inter”coding, motion information is coded by the entropic encoding module 1209and inserted in the bit stream 1210. This motion information is inparticular composed of one or several motion vectors (indicating theposition of the predictor block in the reference images relative to theposition of the block to be predicted) and an image index among thereference images.

The residual obtained according to the coding mode selected by themodule 1206 is then transformed by module 1207. The transform applies toa Transform Unit (TU), that is included into a CU. A TU can be furthersplit into smaller TUs 1006 using a so-called Residual QuadTree (RQT)decomposition. In HEVC, generally 2 or 3 levels of decompositions areused and authorized transform sizes are from 32×32, 16×16, 8×8 and 4×4.The transform basis is derived from a discrete cosine transform DCT.

The residual transformed coefficients are then quantized by aquantization module 1208. The coefficients of the quantized transformedresidual are then coded by means of the entropic coding module 1209 andthen inserted in the compressed bit stream 1210.

In order to calculate the “Intra” predictors or to make an estimation ofthe motion for the “Inter” predictors, the encoder performs a decodingof the blocks already encoded by means of a so-called “decoding” loop1211-1215. This decoding loop makes it possible to reconstruct theblocks and images from the quantized transformed residuals.

The quantized transformed residual is dequantized in module 1211 byapplying the reverse quantization to that provided by module 1208 andreconstructed in module 1212 by applying the reverse transform to thatof the module 1207.

If the residual comes from an “Intra” coding, then in module 1213 theused “Intra” predictor is added to this residual in order to recover areconstructed block corresponding to the original block modified by thelosses resulting from a transformation with loss, here quantizationoperations.

If the residual on the other hand comes from an “Inter” coding, theblocks pointed to by the current motion vectors (these blocks belong tothe reference images 1216 referred to by the current image indices) aremerged then added to this decoded residual in module 1214. In this waythe original block, modified by the losses resulting from thequantization operations, is obtained.

A final loop filter 1215 is applied to the reconstructed signal in orderto reduce the effects created by heavy quantization of the residualsobtained and to improve the signal quality. The loop filter comprisestwo steps, a “deblocking” filter and a linear filtering. The deblockingfiltering smoothes the borders between the blocks in order to visuallyattenuate these high frequencies created by the coding. The linearfiltering further improves the signal using filter coefficientsadaptively determined at the encoder. The filtering by module 1215 isthus applied to an image when all the blocks of pixels of this imagehave been decoded.

The filtered images, also called reconstructed images, are then storedas reference images 1216 in order to allow the subsequent “Inter”predictions taking place during the compression of the following imagesof the current video sequence.

In the context of HEVC, it is possible to use several reference images1216 for the estimation and motion compensation of the current image. Inother words, the motion estimation is carried out on N images. Thus thebest “Inter” predictors of the current block, for the motioncompensation, are selected in some of the multiple reference images.Consequently two adjoining blocks may have two predictor blocks thatcome from two distinct reference images. This is in particular thereason why, in the compressed bit stream, the index of the referenceimage (in addition to the motion vector) used for the predictor block isindicated.

The use of multiple reference images is both a tool for resisting errorsand a tool for improving the compression efficacy. The VCEG grouprecommends limiting the number of reference images to four.

FIG. 10 illustrates a block diagram of a decoder 1300 according to anembodiment of the invention. The decoder is represented by connectedmodules, each module being adapted to implement, for example in the formof programming instructions to be executed by the CPU 1111 of apparatus1000, a corresponding step of a method implementing an embodiment of theinvention.

The decoder 1300 receives as an input a bit stream 1301 corresponding toa video sequence 1210 compressed by an encoder of the HEVC type, such asthe one shown in FIG. 9.

During the decoding process, the bit stream 1301 is first of all decodedentropically by a module 1302.

The residual of the current block is then dequantized by adequantization module 1303. This reverses the quantization carried outby the quantization module 1208 in the encoder 1200. The dequantizeddata is then reconstructed by a reverse transform module 1304 whichperforms a transformation the reverse of that carried out by thetransform module 1207 in the encoder 1200.

The decoding of the data in the video sequence is then carried out imageby image and, within an image, block by block.

The “Inter” or “Intra” coding mode for the current block is extractedfrom the bit stream 1301 and decoded entropically.

If the coding of the current block is of the “Intra” type, the number ofthe predictor is extracted from the bit stream and decoded entropically.The Intra predictor block associated with this index is recovered fromthe data already decoded of the current image.

The residual associated with the current block is recovered from the bitstream 1301 and then decoded entropically. Finally, the Intra predictorblock recovered is added to the residual thus dequantized andreconstructed in a reverse Intra prediction module 1305 in order toobtain the decoded block.

If the coding mode of the current block indicates that this block is ofthe “Inter” type, the motion information is extracted from the bitstream 1301 by the entropic decoding module 1302 and decoded.

This motion information is used in a reverse motion compensation module206 in order to determine the “Inter” predictor block contained in thereference images 1308 of the decoder 1300. In a similar manner to theencoder, these reference images 1308 are composed of images that precedethe image currently being decoded and that are reconstructed from thebit stream (and therefore decoded previously).

The residual associated with the current block is, here also, recoveredfrom the bit stream 1301 and then decoded entropically by module 1302.The Inter predictor block determined is then added to the thusdequantized residual reconstructed in the reverse motion compensationmodule 1306 in order to obtain the decoded block.

At the end of the decoding of all the blocks of the current image, thesame loop filter 1307 as the filter 1215 provided at the encoder is usedto eliminate the block effects and improve the signal quality in orderto obtain the reference images 1308.

The images thus decoded constitute the output video signal 1309 of thedecoder, which can then be displayed and used.

The embodiments described above are based on block partitions of inputimages, but more generally, any type of image 5 portions to encode ordecode can be considered, in particular rectangular portions or moregenerally geometrical portions.

More generally although the present invention has been describedhereinabove with reference to specific embodiments, the presentinvention is not limited to the specific embodiments, and modificationswill be apparent to a skilled person in the art which lie within thescope of the present invention.

Many further modifications and variations will suggest themselves tothose versed in the art upon making reference to the foregoingillustrative embodiments, which are given by way of example only andwhich are not intended to limit the scope of the invention, that beingdetermined solely by the appended claims. In particular the differentfeatures from different embodiments may be interchanged, whereappropriate.

In the claims, the word “comprising” does not exclude other elements orsteps, and the indefinite article “a” or “an” does not exclude aplurality. The mere fact that different features are recited in mutuallydifferent dependent claims does not indicate that a combination of thesefeatures cannot be advantageously used.

1. A method of encoding a mode value representing an intra predictionmode for a current unit to be encoded, the method comprising: derivingfirst, second and third reference intra prediction mode values to encodethe mode value for the current unit from respective intra predictionmodes of at least two neighbouring units of the current unit, whereinthe number of the reference intra prediction mode values, to encode themode value for the current unit, is three, encoding information forspecifying the intra prediction mode for the current unit; and encodingthe current unit using the intra prediction mode for the current unit,wherein deriving the first, second and third reference intra predictionmode values comprises checking whether the respective intra predictionmodes of said at least two neighbouring units are the same or differentand, if the respective intra prediction modes are different, setting thefirst reference intra prediction mode value to a mode valuecorresponding to one of said respective intra prediction modes, settingthe second reference intra prediction mode value to a mode valuecorresponding to another of said respective intra prediction modes, andwhen neither of said first and second reference intra prediction modevalues corresponds to the planar prediction mode, setting the thirdreference intra prediction mode value to a mode value corresponding tothe planar prediction mode, or when one of the first and secondreference intra prediction mode values corresponds to the planarprediction mode, and the other of the first and second reference intraprediction mode values corresponds to a DC prediction mode, the thirdreference intra prediction mode value is set to a mode valuecorresponding to a vertical prediction mode, and if the respective intraprediction modes are the same and that mode is the planar predictionmode, setting the first reference intra prediction mode value to a modevalue corresponding to the planar prediction mode, setting the secondreference intra prediction mode value to a mode value corresponding tothe DC prediction mode and setting the third reference intra predictionmode value to a mode value corresponding to the vertical predictionmode.
 2. The method according to claim 1, wherein the first, second andthird reference intra prediction mode values are usable in that orderfor the encoding of the information for specifying the intra predictionmode for the current unit.
 3. The method according to claim 1,comprising: comparing the mode value for the current unit with at leastone of the first, second and third reference intra prediction modevalues; and selecting, based on the comparison, a process from among atleast first and second processes, to encode the information forspecifying the intra prediction mode for the current unit.
 4. The methodaccording to claim 3, wherein the first process comprises encoding firstinformation indicating a relationship between the mode value for thecurrent unit and at least one of the first, second and third referenceintra prediction mode values, and the second process comprises encodingsecond information representing the mode value for the current unit. 5.The method according to claim 3, wherein the first process is selectedwhen the mode value for the current unit is equal to at least one of thefirst, second and third reference intra prediction mode values, and thesecond process is selected when the mode value for the current unitdiffers from each of the first, second and third reference intraprediction mode values.
 6. The method according to claim 3, wherein thefirst process comprises encoding a flag indicating the mode value forthe current unit is equal to one of the first, second and thirdreference intra prediction mode values.
 7. A method of decoding acurrent unit using an intra prediction mode, the intra prediction modebeing representable by a mode value for the current unit, the methodcomprising: deriving first, second and third reference intra predictionmode values from respective intra prediction modes of at least twoneighbouring units of the current unit, wherein the number of thereference intra prediction mode values, to determine the mode value forthe current unit, is three; decoding information for specifying theintra prediction mode for the current unit; determining the intraprediction mode for the current unit using at least the information; anddecoding the current unit using the determined intra prediction mode forthe current unit, wherein deriving the first, second and third referenceintra prediction mode values comprises checking whether the respectiveintra prediction modes of said at least two neighbouring units are thesame or different and, if the respective intra prediction modes aredifferent, setting the first reference intra prediction mode value to amode value corresponding to one of said respective intra predictionmodes, setting the second reference intra prediction mode value to amode value corresponding to another of said respective intra predictionmodes, and when neither of said first and second reference intraprediction mode values corresponds to the planar prediction mode,setting the third reference intra prediction mode value to a mode valuecorresponding to the planar prediction mode, or when one of the firstand second reference intra prediction mode values corresponds to theplanar prediction mode, and the other of the first and second referenceintra prediction mode values corresponds to a DC prediction mode, thethird reference intra prediction mode value is set to a mode valuecorresponding to a vertical prediction mode, and if the respective intraprediction modes are the same and that mode is the planar predictionmode, setting the first reference intra prediction mode value to a modevalue corresponding to the planar prediction mode, setting the secondreference intra prediction mode value to a mode value corresponding tothe DC prediction mode and setting the third reference intra predictionmode value to a mode value corresponding to the vertical predictionmode.
 8. The method according to claim 7, wherein the first, second andthird reference intra prediction mode values are usable in that orderfor the determining of the intra prediction mode for the current unit.9. The method according to claim 7, comprising: decoding a flagindicating whether the mode value for the current unit is equal to oneof the reference intra prediction mode values; and selecting, based onthe decoded flag, a process from among at least first and secondprocesses, to decode the information for specifying the intra predictionmode for the current unit.
 10. The method according to claim 9, whereinthe first process comprises decoding first information indicating arelationship between the mode value for the current unit and at leastone of the first, second and third reference intra prediction modevalues, and the second process comprises decoding second informationrepresenting the mode value for the current unit.
 11. The methodaccording to claim 9, wherein the first process is selected when themode value for the current unit is equal to at least one of the first,second and third reference intra prediction mode values, and the secondprocess is selected when the mode value for the current unit differsfrom each of the first, second and third reference intra prediction modevalues.
 12. The method according to claim 9, further comprising:decoding the mode value for the current unit using the first, second orthird reference intra prediction mode value when the first process isselected.
 13. A device for encoding a mode value representing an intraprediction mode for a current unit to be encoded, the device comprising:a deriving unit configured to derive first, second and third referenceintra prediction mode values to encode the mode value for the currentunit from respective intra prediction modes of at least two neighbouringunits of the current unit, wherein the number of the reference intraprediction mode values, to encode the mode value for the current unit,is three; and an encoding unit configured to encode information forspecifying the intra prediction mode for the current unit and encode thecurrent unit using the intra prediction mode for the current unit,wherein the deriving unit is further configured to derive the first,second and third reference intra prediction mode values by checkingwhether the respective intra prediction modes of said at least twoneighbouring units are the same or different and, if the respectiveintra prediction modes are different, setting the first reference intraprediction mode value to a mode value corresponding to one of saidrespective intra prediction modes, setting the second reference intraprediction mode value to a mode value corresponding to another of saidrespective intra prediction modes, and when neither of said first andsecond reference intra prediction mode values corresponds to the planarprediction mode, setting the third reference intra prediction mode valueto a mode value corresponding to the planar prediction mode, or when oneof the first and second reference intra prediction mode valuescorresponds to the planar prediction mode, and the other of the firstand second reference intra prediction mode values corresponds to a DCprediction mode, the third reference intra prediction mode value is setto a mode value corresponding to a vertical prediction mode, and if therespective intra prediction modes are the same and that mode is theplanar prediction mode, setting the first reference intra predictionmode value to a mode value corresponding to the planar prediction mode,setting the second reference intra prediction mode value to a mode valuecorresponding to the DC prediction mode and setting the third referenceintra prediction mode value to a mode value corresponding to thevertical prediction mode.
 14. A device for decoding a current unit usingan intra prediction mode, the intra prediction mode being representableby a mode value for the current unit, the device comprising: a derivingunit configured to derive first, second and third reference intraprediction mode values from respective intra prediction modes of atleast two neighbouring units of the current unit, wherein the number ofthe reference intra prediction mode values, to determine the mode valuefor the current unit, is three; and a decoding unit configured to decodeinformation for specifying the intra prediction mode for the currentunit, determine the intra prediction mode for the current unit using atleast the information, and decode the current unit using the determinedintra prediction mode for the current unit, wherein the deriving unit isfurther configured to derive the first, second and third reference intraprediction mode values by checking whether the respective intraprediction modes of said at least two neighbouring units are the same ordifferent and, if the respective intra prediction modes are different,setting the first reference intra prediction mode value to a mode valuecorresponding to one of said respective intra prediction modes, settingthe second reference intra prediction mode value to a mode valuecorresponding to another of said respective intra prediction modes, andwhen neither of said first and second reference intra prediction modevalues corresponds to the planar prediction mode, setting the thirdreference intra prediction mode value to a mode value corresponding tothe planar prediction mode, or when one of the first and secondreference intra prediction mode values corresponds to the planarprediction mode, and the other of the first and second reference intraprediction mode values corresponds to a DC prediction mode, the thirdreference intra prediction mode value is set to a mode valuecorresponding to a vertical prediction mode, and if the respective intraprediction modes are the same and that mode is the planar predictionmode, setting the first reference intra prediction mode value to a modevalue corresponding to the planar prediction mode, setting the secondreference intra prediction mode value to a mode value corresponding tothe DC prediction mode and setting the third reference intra predictionmode value to a mode value corresponding to the vertical predictionmode.
 15. A non-transitory computer readable medium which, containsexecutable instructions which when executed by a computer or processor,causes the computer or processor to carry out a method of encoding amode value representing an intra prediction mode for a current unit tobe encoded, the method comprising: deriving first, second and thirdreference intra prediction mode values to encode the mode value for thecurrent unit from respective intra prediction modes of at least twoneighbouring units of the current unit, wherein the number of thereference intra prediction mode values, to encode the mode value for thecurrent unit, is three; encoding information for specifying the intraprediction mode for the current unit; and encoding the current unitusing the intra prediction mode for the current unit, wherein derivingthe first, second and third reference intra prediction mode valuescomprises checking whether the respective intra prediction modes of saidat least two neighbouring units are the same or different and, if therespective intra prediction modes are different, setting the firstreference intra prediction mode value to a mode value corresponding toone of said respective intra prediction modes, setting the secondreference intra prediction mode value to a mode value corresponding toanother of said respective intra prediction modes, and when neither ofsaid first and second reference intra prediction mode values correspondsto the planar prediction mode, setting the third reference intraprediction mode value to a mode value corresponding to the planarprediction mode, or when one of the first and second reference intraprediction mode values corresponds to the planar prediction mode, andthe other of the first and second reference intra prediction mode valuescorresponds to a DC prediction mode, the third reference intraprediction mode value is set to a mode value corresponding to a verticalprediction mode, and if the respective intra prediction modes are thesame and that mode is the planar prediction mode, setting the firstreference intra prediction mode value to a mode value corresponding tothe planar prediction mode, setting the second reference intraprediction mode value to a mode value corresponding to the DC predictionmode and setting the third reference intra prediction mode value to amode value corresponding to the vertical prediction mode.
 16. Anon-transitory computer readable medium which, contains executableinstructions which when executed by a computer or processor, causes thecomputer or processor to carry out a method of decoding a current unitusing an intra prediction mode, the intra prediction mode beingrepresentable by a mode value for the current unit, the methodcomprising: deriving first, second and third reference intra predictionmode values from respective intra prediction modes of at least twoneighbouring units of the current unit, wherein the number of thereference intra prediction mode values, to determine the mode value forthe current unit, is three; decoding information for specifying theintra prediction mode for the current unit; determining the intraprediction mode for the current unit using at least the information; anddecoding the current unit using the determined intra prediction mode forthe current unit, wherein deriving the first, second and third referenceintra prediction mode values comprises checking whether the respectiveintra prediction modes of said at least two neighbouring units are thesame or different and, if the respective intra prediction modes aredifferent, setting the first reference intra prediction mode value to amode value corresponding to one of said respective intra predictionmodes, setting the second reference intra prediction mode value to amode value corresponding to another of said respective intra predictionmodes, and when neither of said first and second reference intraprediction mode values corresponds to the planar prediction mode,setting the third reference intra prediction mode value to a mode valuecorresponding to the planar prediction mode, or when one of the firstand second reference intra prediction mode values corresponds to theplanar prediction mode, and the other of the first and second referenceintra prediction mode values corresponds to a DC prediction mode, thethird reference intra prediction mode value is set to a mode valuecorresponding to a vertical prediction mode, and if the respective intraprediction modes are the same and that mode is the planar predictionmode, setting the first reference intra prediction mode value to a modevalue corresponding to the planar prediction mode, setting the secondreference intra prediction mode value to a mode value corresponding tothe DC prediction mode and setting the third reference intra predictionmode value to a mode value corresponding to the vertical predictionmode.